The emergence of stereotyped behaviors in C. elegans 
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Animal behaviors are sometimes decomposable into discrete, stereotyped elements. In one model, 
such behaviors are triggered by specific commands; in the extreme case, the discreteness of behavior 
is traced to the discreteness of action potentials in the individual command neurons. We use the 
crawling behavior of the nematode C. elegans to explore the opposite extreme, in which discreteness 
and stereotypy emerges from the dynamics of the entire behavior. A simple stochastic model for the 
worm's continuously changing body shape during crawling has attractors corresponding to forward 
and backward motion; noise-driven transitions between these attractors correspond to abrupt re- 
versals. We show that, with no free parameters, this model generates reversals at a rate within error 
bars of that observed experimentally, and the relatively stereotyped trajectories in the neighborhood 
of the reversal also are predicted correctly. 



Many organisms, from bacteria to humans, exhibit dis- 
crete, stereotyped motor behaviors. A common model 
is that these behaviors are stereotyped because they are 
triggered by specific commands, and in some cases we can 
identify "command neurons" whose activity provides the 
trigger [1]. In the extreme, discreteness and stereotypy of 
the behavior reduces to the discreteness and stereotypy of 
the action potentials generated by the command neurons, 
as with the escape behaviors in fish triggered by spiking 
of the Mauthner cell [2]. But the stereotypy of spikes 
itself emerges from the continuous dynamics of currents, 
voltages and ion channel populations [H |4] . Is it possi- 
ble that, in more complex systems, stereotypy emerges 
not form the dynamics of single neurons, but from the 
dynamics of larger circuits of neurons, perhaps coupled 
to the mechanics of the behavior itself? Here we explore 
this possibility in the context of crawling behavior in the 
nematode C. elegans [5]. These worms generate abrupt 
reversals of direction [6l [7], and it is the emergence of 
these discrete events that we try to understand. 

The problem of reversals in C. elegans is interesting 
in part because the underlying neural circuitry includes 
a nominal command neuron, AVA [8 , whose activity is 
correlated with forward vs. backward crawling [9 . On 
the other hand, AVA is an inter neuron in a network, and 
it is not clear whether the decision to reverse direction 
can be traced to a single cell. Even when AVA is ablated, 
reversals occur, although the distribution of times spent 
in the backward crawling state shifts [7 . Further, most 
neurons in C. elegans are thought not to generate ac- 
tion potentials, so even if a single neuron dominates the 
decision it is not obvious why the trajectory of a rever- 
sal would be stereotyped. Rather than probing further 
into the neural circuitry, it may be useful to step back 
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and give a more quantitative description of the reversal 
behavior itself. 

Locomotion involves changes of body shape. In pre- 
vious work [To], we have have shown that as C. ele- 
gans crawls, its body moves through a "shape space" 
of restricted dimensionality. Of the four dimensions that 
capture ~ 95% of the variance in body shape, oscilla- 




-2 -1 1 2 ""o 2 4 6 8 

ai t(s) 



FIG. 1: Reversals in shape space, following Ref [TO]. (a) 
Tracking video microscopy gives both the x-y trajectory of 
the worm as it crawls on an agar plate, and the shape of the 
worm's body at high resolution, (b) Shape is described by 
the tangent angle 6 vs. arc length s, in intrinsic coordinates 
such that f dsO{s) = 0. (c) We decompose 0{s) into four 
dominant modes, (d) Amplitudes along the first two modes 
oscillate, with nearly constant amplitude but time varying 
phase = tan~^(a2/ai); here the amplitudes are normalized 
so that (af) = 1. (e) The phase trajectories exhibit abrupt 
reversals, moments when u = d(j)/dt change sign. Compar- 
ing the points marked here and in (a), these phase reversals 
correspond to reversals in crawling direction. 
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tory motions along the first two modes correspond to the 
propulsive wave which passes along the worm's body and 
drives it forward or backward. Indeed, the rate at which 
the phase of this oscillation changes predicts, quantita- 
tively, the velocity of the worm's motion [11 . As em- 
phasized in Fig[l] this correspondence includes the fact 
that abrupt changes in the sign of the phase velocity pre- 
dict the points where the worm suddenly "backs up" and 
reverses its crawling direction. 

In Ref [W we constructed a simple model for the dy- 
namics of the phase <j){t). Since the worm can crawl both 
forward and backward, a minimal for the phase dynamics 
is a second order system. Since the dynamics are noisy, 
we try to write something analogous to the Langevin 
equation for a Brownian particle subject to forces. We 
recall that for the Brownian particle, we have 



dx 

I— = f{x,v)+^{t), 
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where m is the mass of the particle, /(x, v) describes the 
average forces acting on the particle, and ^{t) is the ran- 
dom force resulting from molecular collisions. By anal- 
ogy, then, we write for the phase of the worm's shape 
oscillations 
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FIG. 2: Langevin model for the phase dynamics, Eq's (|3j 
[4|. (a) The deterministic component of the force F{uj^<p), 
in units cycles/s^. The black line is the attracting limit cy- 
cle corresponding to forward crawling, and the white dashed 
lines mark boundaries for our analysis of trajectories that 
start within this attractor. (b) The state dependent noise 



cr(a;, 0), in units cycles/ 



(c) A sample of the trajectories 



resulting from Eq's ([3]|4|, illustrating transitions between at- 
tractors at positive and negative cj, corresponding to forward 
and backward crawling. 
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Here we allow the possibility that, unlike a Brownian par- 
ticle in equilibrium at a fixed temperature, the strength 
of the noise varies with the state of the system. Will still 
assume, however, that the noise refiects events on very 
short time scales, so that 



{7j{tHt'))=6{t-t'). 
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There is a substantial literature on how one learns 
Langevin models from real data; see, for example, Refs 
[12 113 • A central difficulty is not to overfit by allowing 
for arbitrarily complex functions describing the force. To 
regularize the learning problem we assumed that the force 
could be written as a polynomial in cj and a Fourier series 
in (/), 
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Then if we have long trajectories ^(t), the parameters 



amp are those which minimize 
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where the average is computed over the long trajectory; 
in practice we average over five long trajectories from 
each of twelve worms, for a total of two hours of data. 
The optimal choice of the series orders P and M are 
found by fitting to 90% of the data and minimizing the 
generalization error computed on the remaining 10%; we 
find P = M = 5. Note also that the trajectories are 
given experimentally as discrete time samples, here with 
time steps At = 1/32 s, so that all time derivatives must 
be constructed carefully; to minimize the impact of mea- 
surements errors we smooth the mode amplitudes ai{t) 
and a2{t) with fourth order polynomials before comput- 
ing the phase. Finally, the noise strength is defined by 



cr^(cj,^) = At 



duj 
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where the average now is taken over those moments in 
the data when the state of the system is characterized 
by particular values of uo and (j). The results of this con- 
struction are shown in Fig|2|L and b [10 . 

It is important to emphasize that the construction of 
the Langevin model allows us to look only at local fea- 
tures of the phase trajectory; we do not use, directly, 
any information about what happens on long time scales. 
Nonetheless, as in the corresponding physics problems, 
the model predicts a variety of phenomena that emerge 
on long time scales. As described in Ref the un- 
derlying deterministic model (where we set (7 = 0) has 
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FIG. 3: Survival times, (a) We measure the probability that a 
worm's trajectory which is in the neighborhood of the froward 
attractor at time t has not crossed to negative phase velocity 
by time t + r. The decay is exponential, with a mean time 
(r) = 16.3 =b 0.3 s. (b) The predicted mean time (r) depends 
on the noise level in the model. If we scale by a factor /3, 
then for large f3 we find 1/(t) oc exp(— analogous to the 
Arrhenius temperature dependence of chemical reaction rates. 
Cross shows the measured 1 / (r) at the real temperature f3 = 
1; vertical error bar is the standard deviation of the reversal 
rate, and horizontal error bar is the standard deviation of the 
noise level, both computed across the population of worms. 



multiple attr actors, limit cycles corresponding to forward 
and backward crawling, and fixed points corresponding 
to pauses. In the full dynamics with noise, the system 
is predicted to remain near these attractors for extended 
periods of time. The noise drives random motions in the 
neighborhood of the attractors, as well as phase diffu- 
sion along the limit cycles; these are effects that we can 
think of as perturbations to the deterministic dynamics. 
There is also a non-perturbative effect: noise drives sud- 
den transitions from one attractor to another, as seen 
in Fig In particular, there are transitions from the 
uj > attractor to the uj < attractor, and these should 
correspond to reversals in the direction of crawling, as 
seen in Fig[T^. 

To quantify the predicted and observed reversals, we 
measure the survival probability in the forward crawl- 
ing attractor. As we observe the trajectory we 
choose, at random, a moment in time where phase ve- 
locity 0.1 < cc; < 0.6rad/s, a region indicated by the 
dashed white lines in Fig [2^. Then we declare that a 
reversal has occurred if the phase velocity falls below 
zero; the survival probability P{r) is the probability that 
this has not happened after a delay r. If transitions 
are the result of brief events, well separated in time, 
then there should be no memory form one to the next, 
and we expect the survival probability to decay expo- 
nentially, P{r) = exp(— r/(r)); this is what we observe 
both in simulated trajectories and in the actual data, 
as shown in Fig |3] In the data, the mean interval is 
(r) = 16.3 ± 0.3 s, where the error is the standard devia- 
tion across 33 worms, each observed for 35 minutes; this 
is a completely independent data set, with different in- 
dividual worms, from that used in learning the Langevin 



model. The model predicts (r) = 15.7 s, which agrees 
within 4% accuracy. 

The escape from one attractor to another under the 
influence of noise is like the escape from one metastable 
configuration to another via Brownian motion — a chem- 
ical reaction [M]. The strength of the noise, plays the 
role of temperature, and we expect that if the tempera- 
ture changes we should see the Arrhenius law, as shown 
in Fig ^p. The actual "temperature" is a bit too high 
for the Arrhenius law to be valid, but the mean time be- 
tween intervals is still an order of magnitude longer than 
the characteristics times for motion within the forward 
or backward crawling attractors. Also, when we estimate 
the noise level from the trajectories, there is an error in 
our estimate, and this propagates to give an error in the 
predicted mean time between attractors which is com- 
parable to the deviation between the prediction and the 
data. We conclude that noise-driven escape from the 
forward crawling attractor provides a quantitatively ac- 
curate model for the observed rate of reversals, without 
introducing any new parameters; the long time between 
reversals emerges from the dynamics in the same way the 
long time between chemical reaction events emerges from 
the fast Brownian dynamics of the molecules. 

One of the important results in the theory of thermally 
activated escape over a barrier is that, in the low noise 
limit, the escape trajectories become stereotyped [15]|16]. 
By analogy, then, we expect that the trajectories that 
allow the worm to escape from the forward crawling at- 
tractor also should be stereotyped, or at least clustered 
around some prototypical trajectories. Detailed analysis 
of the simulations show that there are in fact two such 
clusters, corresponding to transitions in which the sign of 
UJ changes while the phase (j) is positive or negative; this 
doubling is also seen in the data (not shown). If we focus 
on the transitions that occur with negative phase, we can 
align all the phase trajectories at the moment where co 
changes sign, and estimate the probability distribution 




FIG. 4: Emergence of stereotyped behaviors, (a) The condi- 
tional density p((/)|t) constructed from an ensemble of worm 
trajectories aligned to exit the forward attractor at t = via 
a path with 0(0) < 0. Color scale is for \n[p • (Irad)]. (b) 
The same density generated from simulations of the stochas- 
tic model, Eq's Plffl. 
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p{(j)\t) at any time t relative to the switch. As we see 
in Fig [4j both the real data and the simulations show 
that this distribution is concentrated fairly tightly, and 
this extends back for several seconds before the moment 
of the reversal itself. Comparing Figs and b, we see 
that the conditional density derived from worm motion 
appears as a noisy version of the density derived from the 
stochastic dynamics. 

In summary, we have found a surprisingly simple model 
for the dynamics of C. elegans crawling. The construc- 
tion of the model depends on analyzing trajectories over 
very short time scales, essentially trying to map the way 
in which acceleration depends on position and velocity 
in a simple phase space. But if we take this local de- 
scription seriously, we predict phenomena on much longer 
time scales. As with models of single neurons and small 
circuits, our model has multiple attr actors, which we can 
identify with distinct behavioral states, and spontaneous 
transitions among these attractors. It is one class of these 
spontaneous transitions, reversals, which we have focused 
on here. Because the transitions are driven by noise, 
the rate of transitions is suppressed exponentially rela- 
tive to the natural time scales of the dynamics, in the 
same way that chemical reaction rates are exponentially 
slower than the time scales of small amplitude molecu- 
lar motions. We find that the reversal rates predicted by 
the model agree with experiment with an accuracy of 4%, 
within the errors of our estimates of the underlying noise 
levels. In more detail, the model predicts that the re- 
versals occur via stereotyped trajectories, and these too 
agree with experiment. Rather than being traced to dis- 
crete, stereotyped commands, the stereotypy of reversals 
is an emergent property of the behavioral dynamics as a 
whole. 
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